Simulation of Consensus Based Approaches to Mitigate the Challenges in Crowdsourcing
نویسندگان
چکیده
Crowdsourcing is an emerging area and has evolved as a powerful practice to leverage the collective intelligence of the crowd. It has been applied in various domains ranging from creative resolution of a problem to improving the business process using several platforms such as CrowdFlower, Freelancer and Amazon Mechanical Turk. Crowd is a creative workforce that has niche abilities to solve complex business challenges across various domains. It can be seen as an alternate workforce by participating in all phases of software development life cycle. However the common problem seen in crowdsourcing is the quality of the work performed by the crowd mostly due to the anonymity of the crowd member. In this work, we evaluated consensus based approach to assess the quality of the work done by the crowd through a simulation of crowd behavior. We also investigated the performance of these techniques for evaluating crowd members.
منابع مشابه
Challenges of Simulation Training in Nursing Student Education and Proposing Effective Approaches: A Systematic Review Study
Introduction: One of the effective methods of teaching students is the use of simulation. Some simulation challenges are mentioned in the most studies; However, different studies do not agree on the types of challenges and their approaches. Objective: The present study is a systematic review to identify the challenges of education by simulation and provide effective approaches in educating nur...
متن کاملThird-order Decentralized Safe Consensus Protocol for Inter-connected Heterogeneous Vehicular Platoons
In this paper, the stability analysis and control design of heterogeneous traffic flow is considered. It is assumed that the traffic flow consists of infinite number of cooperative non-identical vehicular platoons. Two different networks are investigated in stability analysis of heterogeneous traffic flow: 1) inter-platoon network which deals with the communication topology of lead vehicles and...
متن کاملOutput Consensus Control of Nonlinear Non-minimum Phase Multi-agent Systems Using Output Redefinition Method
This paper concerns the problem of output consensus in nonlinear non-minimum phase systems. The main contribution of the paper is to guarantee achieving consensus in the presence of unstable zero dynamics. To achieve this goal, an output redefinition method is proposed. The new outputs of agents are functions of original outputs and internal states and defined such that the dynamics of agents a...
متن کاملUsing crowdsourcing for labelling emotional speech assets∗
The success of supervised learning approaches for the classification of emotion in speech depends highly on the quality of the training data. The manual annotation of emotion speech assets is the primary way of gathering training data for emotional speech recognition. This position paper proposes the use of crowdsourcing for the rating of emotion speech assets. Recent developments in learning f...
متن کاملThe Zeitgeist of Challenging the Evidence. A Perspective on the International Consensus Meeting on Periprosthetic Joint Infection
Background: The economic burden of the treatment of periprosthetic joint infection (PJI) is high and the treatment of PJI has a high degree of international controversy. Several papers have declared the International Consensus Meeting on Periprosthetic Joint Infection (ICMPJI) to be the "flawless pledge of international academics" to overcome the challenges of musculoskeletal infections. The p...
متن کامل